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Validation  of  a psychomotor/perceptual  test  battery 


1.  INTRODUCTION 

The  present  selection  and  classification  instru- 
ments of  the  Air  Force  consist  almost  entirely  of 
paper-and-pencil  measures  of  the  traditional  cogni- 
tive abilities— verbal  ability,  mathematical  reason- 
ing, spatial  perception,  mechanical  and  general 
knowledge,  etc.  While  these  tests  possess  some 
validity  for  the  selection  of  personnel  for  technical 
training,  many  of  the  tasks  which  comprise  Air 
Force  technical  training  courses  involve  some  de- 
gree of  psychomotor/perceptual  skill  which  pre- 
vious research  (i.e..  Hunter,  1975;  McLaurin, 
1973)  has  indicated  is  relatively  untapped  by  con- 
ventional paper-and-pencil  tests. 

Furthermore,  it  is  often  argued  that  conven- 
tional paper-and-pencil  testing  may  disc'iminate 
against  those  individuals  from  disadvantaged  social 
or  educational  backgrounds.  A previous  study 
(Hunter,  1975),  which  used  this  psychomotor/per- 
ceptual battery  of  tests,  indicated  that  while  there 
were  relatively  consistent  differences  between  con- 
ventionally defined  high-  and  low-ability  groups  on 
psychomotor/ perceptual  measures,  these  differ- 
ences were  far  less  than  the  differences  between 
the  groups  on  traditional  paper-and-pencil  meas- 
ures. Thus,  the  use  of  psychomotor/perceptual 
measures  as  predictors  of  technical  training  success 
might  allow  the  assessment  of  relatively  unique 
variance  while  at  the  same  time  avoiding  one  of 
the  major  criticisms  of  conventional  testing. 

This  study  was  designed  to  address  the  first  of 
these  questions-how  valid  are  these  measures  for 
the  prediction  of  training  outcomes?  Although  the 
battery  was  originally  designed  to  be  used  with 
enlisted  personnel,  the  characteristics  and  tasks  of 
the  tests  contained  in  the  battery  also  suggested  a 
possible  utility  in  the  selection  of  personnel  for 
navigator  training.  Therefore,  two  samples  of  Air 
Force  personnel  were  tested— officer  trainees  se- 
lected for  navigator  training  and  enlisted  personnel 
who  attended  a variety  of  technical  training 
schools-and  independent  analyses  of  the  data 
gathered  from  these  two  samples  were  performed. 


II.  TEST  DESCRIPTIONS* 

Psychomotor/Perceptual  Battery 

Test  I.  Kinesthetic  Memory -requites  that  the 
subject  learn  a sequence  of  switch  manipulations 


' Complete  descriptions  of  the  test  proce- 
dures-inciuding  instructions  to  the  subjects,  computer 
operations,  test  administrator’s  actions,  and  listings  of  all 
stimuli  used  in  each  test -ate  contained  in  Appendix  A of 
AI  HRL-TR-7S-60. 


and  then  repeat  those  manipulations  while  wearing 
opaque  gog^es.  The  subject  is  shown  four  geomet- 
ric figures  ananged  in  a horizontal  line  across  the 
screen.  The  subject  is  instructed  to  pull  down  the 
toggle  switch  that  is  associated  with  each  of  the 
figures,  in  the  order  in  which  they  appear  on  the 
screen  (left  to  right).  Before  initiating  the  switch 
pulling  and  after  completion  of  the  response,  the 
subject  is  required  to  keep  two  “home”  keys  pres- 
sed down.  Release  of  one  of  these  buttons,  when 
the  subject  initiates  his  response,  causes  the  screen 
to  be  erased  so  that  he  cannot  use  it  for  reference 
while  performing  the  task.  The  subject  receives  12 
learning  trials  in  which  the  order  of  the  figures 
across  the  screen  is  always  the  same  and  in  which  a 
bell  tone  accompanies  the  onset  of  the  stimulus. 
After  completion  of  these  learning  trials,  the  sub- 
ject is  instructed  to  put  on  a pair  of  opaque 
gog^es  so  that  he  is  no  longer  able  to  see  the 
response  panel.  After  he  has  done  so,  he  is  told  to 
repeat  the  switch  activation  sequence  every  time 
he  hears  the  bell  tone.  Twelve  trials  are  given  in 
this  condition.  The  measures  obtained  are  (a)  Cor- 
rect Answers— the  number  of  times  he  correctly 
completes  the  switch  activation  sequence  while 
wearing  the  goggles,  and  (b)  Response  Time— 
which  is  the  time  required  for  the  completion  of 
each  of  the  blind  trials  measured  from  release  of 
one  of  the  “home”  buttons  to  comjietion  of  the 
activation  sequence. 

Test  2.  Perceptual  Speed— presents  the  subject 
with  four  geometric  figures  anayed  across  the 
screen  as  in  Test  1 . However,  in  this  test  the  order- 
ing’ of  the  figures  across  the  screen  is  quasi- 
random, so  that  no  presentation  is  identical  to  the 
preceding  one.  The  subject  is  given  two  practice 
trials  followed  by  20  scored  trials.  In  addition  to 
the  Correct  Answers  and  Response  Time  measures 
described  for  Test  1 , a measure  called  Perception 
Time  is  also  obtained.  This  is  the  lengtli  of  time 
that  the  subject  studies  the  display  before 
initiating  his  response,  measured  from  onset  of  the 
stimulus  presentation  to  release  of  one  of  the 
“home”  keys. 

Test  3.  Performance  Under  Stress -is  very 
similar  to  Test  2,  except  that  some  of  the  figures 
in  the  stimulus  are  shaded.  The  subject  is 
instructed  to  pull  down  the  toggle  switch 
associated  with  unshaded  figures,  as  he  did  in  Test 
2,  and  to  push  up  the  toggle  switch  associated  with 
shaded  figures.  To  increase  the  subject’s  stress 
level,  an  audio  tape  recording  of  compressed 
tower-to-aircraft  communications  is  played  during 
the  test.  No  responses  to  these  messages  are  re- 
quired of  the  subject,  and  he  is  instructed  to 


ignore  them  as  much  as  he  can.  Two  practice  trials 
are  given  followed  by  20  scored  trials.  The 
measures  obtained  are  the  same  as  in  Test  2. 

Test  4.  /Cssodafive  Learning -uses  the  key- 
board located  in  the  center  of  the  panel.  The  sub- 
ject is  shown  some  of  the  figures  on  the  keyboard 
paired  with  “stick  figure”  drawings  of  common 
objects  (i.e.,  table,  man,  board)  or  novel  geometric 
figures  and  is  instructed  to  learn  the  pairings.  Each 
pair  of  figures  is  shown  to  the  subject  three  times. 
During  Part  1 of  this  test,  the  pairs  of  figures  are 
displayed  for  2 seconds  per  presentation  during 
the  learning  trials.  After  being  given  the  learning 
trials,  the  subject  is  then  shown  each  of  the  stim- 
ulus figures  one  at  a time  and  is  instructed  to  press 
the  keyboard  button  figure  that  was  paired  with 
the  figure  on  the  screen.  One  recall  trial  is  given 
for  each  of  the  eight  stimulus  figures  used. 

Part  2 of  the  test  is  identical  to  Part  1 , except 
that  the  presentation  time  of  the  pairs  of  figures  in 
the  learning  phase  is  changed  to  1 /2  second.  Eight 
new  stimulus  figures  are  used  and,  as  in  Part  1 , 24 
learning  trials  are  followed  by  ei^t  recall  trials. 
The  measures  obtained  from  both  parts  of  this  test 
are  Correct  Answers,  which  is  the  number  of  times 
the  subject  responds  to  the  recall  presentations 
with  the  correct  keyboard  figure. 

Test  5.  Memory  ( Immediat ej Delayed)— in'io\yes 
both  immediate-  and  short-term  memory  of 
symbols  under  continuously  changing  storage 
state.  The  immediate  memory  test  consists  of  a 
continuous  random  series  of  presentations  of  one 
of  the  nine  geometric  keyboard  figures.  The  sub- 
ject is  instructed  to  depress  the  appropriate  key- 
board button  for  the  figure  which  appeared  two 
figures  back  when  the  third  figure  appears  on  the 
display.  Each  time  a new  figure  appears,  the  sub- 
ject is  to  press  the  appropriate  button  for  the 
figure  which  appeared  two  back.  Each  of  the  nine 
figures  on  the  keyboard  is  presented  three  times, 
in  a quasi-random  order,  requiring  a total  of  25 
responses.  In  the  immediate  memory  test  (Part  1 ), 
the  figures  are  displayed  for  a 2-second  stimulus 
duration  with  a 2-second  intersignal  interval. 
Before  the  test  begins,  the  subject  is  given  five 
practice  presentations  requiring  three  responses. 

The  delayed  memory  portion  of  the  test  (Part 
2)  has  an  intersignal  interval  of  5 seconds.  For 
both  parts,  the  score  (Correct  Answers)  is  the 
number  of  correct  responses. 

Test  6.  Concept  /dentification—iequiies  that 
the  subject  identify  the  common  element  in  a 
series  of  geometric  figures.  Both  positive  and 


negative  instances  of  the  concept  (presence  or 
absence  of  a right  angle,  or  presence  of  four  or  five 
sides)  are  displayed  an  equal  number  of  times.  The 
concept  to  be  used  for  any  particular  subject  is 
determined  by  the  computer  choosing  randomly 
from  among  the  four  concepts  available. 

The  subject  is  initially  informed  that  some  of 
the  figures  he  will  see  on  the  screen  are  alike  in  a 
certain  way-that  they  have  some  property  or  fea- 
ture in  common.  The  subject  is  instructed  to  press 
the  right-hand  “home”  key  when  the  figure  on  the 
screen  has  the  certain  characteristic  that  makes  it 
like  the  others,  and  to  press  the  left-hand  home 
key  if  the  figure  on  the  screen  does  not  possess  the 
certain  property  which  makes  it  like  the  others. 
After  pressing  either  button,  the  subject  receives 
feedback  regarding  the  correctness  of  his  choice  in 
the  form  of  a check  mark  on  the  screen  for  a 
correct  response  and  an  “X”  for  an  incorrect  re- 
sponse. An  “X”  also  occurs  after  5 seconds  if  no 
response  is  made  by  the  subject.  The  presentation 
of  the  next  figure  follows  approximately  1 second 
after  the  display  of  the  feedback  information.  No 
practice  trials  are  given,  and  the  subject  receives  48 
trials  for  score.  The  measure  obtained  (Correct 
Answers)  is  the  number  of  times  ihe  subject 
correctly  identifies  the  presence  or  absence  of  the 
selected  property. 

Test  7.  Performance  Under  Divided 
Attention— invoWes  the  performance  of  two  com- 
pensatory tracking  tasks  at  the  same  time.  Using 
the  hand-controUer  located  to  the  right  of  the  re- 
sponse panel,  the  subject  tries  to  keep  a short  hori- 
zontal line  as  close  to  the  center  of  the  screen  as 
he  can.  The  line  is  moved  either  up  or  down,  away 
from  the  center  by  a forcing  function.  At  the  same 
time,  the  subject  is  required  to  use  the  hand- 
controller  to  the  left  of  the  response  panel  to  track 
the  null  point  between  two  tones  (Morse  “A”  and 
“N”).  The  null  point  is  moved  by  a second  forcing 
function  so  that  the  subject  must  make  continuous 
adjustments  to  stay  at  the  null  point. 

Practice  trials  are  given  on  the  tasks  (singly  and 
together  before  the  four  1 -minute  trials  for  score 
begin.  The  measures  obtained  are  the  summed 
absolute  displacements  of  the  two  hand-controllers 
from  the  target  points  for  each  minute  of  the  test. 
For  the  visual  tracking  task,  these  measurements 
would  be  in  terms  of  addressable  scope  units 
(approximately  .01  inch),  and  for  the  audio  track- 
ing task  the  unit  of  measurement  is  the  digital 
analog  of  the  hand-controller  voltage. 
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III.  SUBJECT  TESTING 
Sample  A-Officer  Trainees 

Officer  (navigator)  trainees  were  tested  while  in 
attendance  at  the  Air  Force  Officer  Training 
School,  Medina  Annex,  Lapkland  AFB,  Texas. 
Approximately  120  trainees  were  tested  over  a 
6-month  period.  Analyses  were  based  upon  a sub- 
set of  77  trainees  for  whom  valid  test  scores  and 
training  criteria  were  available. 

Sample  B- Enlisted  Personnel 

Enlisted  personnel  were  tested  during  or 
immediately  after  completion  of  basic  military 
training  at  Lackland  AFB,  Texas.  Approximately 
500  subjects  were  tested  over  a 24-month  period. 
Analyses  were  based  upon  a subset  of  395  subjects 
for  whom  valid  test  scores  and  training  outcome 
criteria  were  available.  Distribution  of  the  enlisted 
subjects  by  career  field  is  given  in  Table  1 . 


IV.  DATA  ANALYSIS 

Sample  * Officer  Trainees 

d Standard  deviations  for  the  psycho- 
' uial  test  scores  were  computed  and 

able  2.  Measures  labeled  “Correct 
are  the  number  of  correct  responses  ob- 
ijuicd  during  each  test.  Measures  labeled  “Mean 
Response  Time”  or  “Mean  Perception  Time”  were 
formed  by  taking  the  arithmetic  average  of  the 
perception  or  response  times  of  all  items  in  the 
test  (excluding  items  to  which  the  subject  did  not 
respond  and,  hence,  had  a perception  or  response 
time  of  zero).  The  incidence  of  the  zero  time 
scores  for  tests  1, 2,  and  3 are  also  reported. 

Means  and  standard  deviations  for  the  training 
outcome  criterion  and  Air  Force  Officer  Qualify- 
ing Test  (AFOQT)  composites  were  also  computed 
and  are  given  in  Table  3. 

Intercorrelations  among  psychomotor/ 
perceptual  scores,  training  criteria,  and  AFCXJT 
composites  are  gi.ven  in  Table  5. 

A regression  problem  comparing  the  relative 
contributions  of  AFOOT  composites  and  psycho- 
motor/perceptual test  scores  for  the  prediction  of 
training  outcome  (pass/fail)  was  performed  and  is 
summarized  in  Table  6. 

Corrections  for  “shrinkage”  (using  the  formula 
given  in  Guilford  and  Fruchter,  1973,  p.  366)  were 
applied  to  the  observed  multiple  correlations,  and 
these  corrected  R^s  are  also  given  in  Table  6. 


Sample  B- Enlisted  Personnel 

Means  and  standard  deviations  for  the  psycho- 
motor/perceptual test  scores  using  the  entire 
sample  (N  = 395)  are  given  in  Table  2.  Means  and 
standard  deviations  for  the  Armed  Services  Voca- 
tional Aptitude  Battery  (ASVAB)  composites  and 
training  outcome  criteria  were  computed  for  the 
entire  sample  and  are  given  in  Table  4. 

Intercorrelations  among  the  psych omotor/- 
perceptual  test  scores,  ASVAB  composites,  and 
training  outcome  criteria  are  given  in  Table  7. 

In  an  effort  to  examine  the  validity  of  the  tests 
for  specific  training  areas,  four  subsamples  were 
selected  from  the  total  sample.  These  subsamples 
were  comprised  of  subjects  in  career  fields  20  (N  = 
37),  43  (N  = 1 22),  46  (N  = 62),  and  90  (N  = 35). 

The  correlations  of  the  psychomotor/ 
perceptual  test  scores  and  ASVAB  composites 
with  tlie  training  criteria  are  given  in  Tables  8,  9, 
10,  and  1 1 for  the  respective  career  fields. 

Table  1 2 summarizes  regression  problems  per- 
formed to  compare  the  relative  contributions  of 
psychomotor/perceptual  tests  and  ASVAB  com- 
posites for  three  training  criteria  for  the  total 
sample.  Tables  13  and  14  summarize  regression 
problems  performed  using  the  career  fields  -ft  and 
46  subsamples,  respectively.  Sufficient  subjects 
were  not  available  for  meaningful  comparisons 
within  other  career  fields. 

Corrected  R^s  are  also  given  in  Tables  12,  13, 
and  14  for  each  regre^ion  problem. 

V.  RESULTS  AND  DISCUSSION 

Sample  A— Officer  Trainees 

As  expected,  several  of  the  psychomotor/ 
perceptual  measures  were  found  to  be  individually 
predictive  of  training  outcomes  for  both  the 
officer  trainees  and  enlisted  samples.  For  the 
officer  trainees,  the  best  single  predictor,  of 
success/failure  in  navigatoi  training  was  Test 
1-Mean  Response  Time  (A-8),  with  Test 
7-Correct  Answers  (A-7)  and  Test  5— Correct  An- 
swers (Part  1)  (A-17)  being  the  second  and  third 
best  single  predictors. 

Each  of  these  predictors  correlated  over  .20 
with  the  pass/fail  criterion,  while  the  Quantitative 
Composite  of  the  AFOQT  correlated  . 1 5 with  the 
criterion.  None  of  the  other  AF(X)T  composites 
correlated  over  .08  with  the  criterion,  including 
the  Navigator  composite  which  correlated  only 
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Table  1.  Distribution  of  Enlisted  Subjects  by  Career  Field 
(N=395) 


Caiwr  Field 

Ellminta 

Graduate 

Total 

20  — Intelligence 

15 

22 

37 

23  — Audiovisual 

2 

6 

8 

25  — Weather 

0 

4 

4 

27  — Command  Control  Systems  Operations 

1 

4 

5 

29  — Communications  Operations 

0 

9 

9 

30  — Communications  — Electronics  Systems 

3 

14 

17 

32  — Avionics  Systems 

4 

10 

14 

36  — Wire  Communication  Systems  Maintenance 

1 

2 

3 

39  — Maintenance  Analysis 

0 

1 

1 

42  — Airman  Aircraft  Systems  Maintenance 

0 

4 

4 

43  — Aircraft  Maintenance 

1 

121 

122 

44  — Missile  Maintenance 

1 

8 

9 

46  — Munitions  and  Weapons  Maintenance 

6 

56 

62 

51  — Computer  Systems 

0 

2 

2 

53  — Metalworking 

0 

2 

2 

54  — Mechanical/Electrical 

5 

7 

12 

55  — Structural/Pavements 

1 

0 

1 

56  - Sanitation 

0 

1 

1 

57  - Fire  Protection 

0 

1 

1 

60  — Transportation 

1 

6 

7 

63  — Fuel  &rvices 

0 

3 

3 

64  - Supply 

0 

3 

3 

70  — Administrative 

0 

16 

16 

73  — Personnel 

0 

1 

1 

79  — Information 

1 

1 

2 

81  — Security  Police 

0 

8 

8 

90  - Medical 

4 

31 

35 

91  — Medical 

1 

0 

1 

98  — Dental 

0 

2 

2 

99  — Other 

0 

3 

3 
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Table  2.  Means  and  Standard  Deviations  for  Navigator 
and  Enlisted  Samples  on  Psychomotor/Perceptual  Measures 


p 

»yc 

homotor/Perceptual 

Measures 

NavKiaton  (N  = 77) 

Enlisted  (N  c 

Mean 

SO 

Mean 

SD 

Test  1 



Correct  Answers 

13.36 

6.83 

10.76 

7.86 

Test  1 

— 

Mean  Response  Time 

218.89 

44.79 

255.18 

128.32 

Test  2 

- 

Correct  Answers 

13.19 

4.76 

11.95 

6.16 

Test  2 

- 

Mean  Perception  Time 

166.77 

27.07 

196.20 

52.75 

Test  2 

- 

Mean  Response  Time 

156.31 

27.43 

193.46 

114.82 

Test  3 

— 

Correct  Answers 

».2! 

5.92 

5.15 

5.48 

Test  3 

- 

Mean  Perception  Time 

226.72 

46.89 

258.19 

93.78 

Test  3 

_ 

Mean  Response  Time 

237.43 

56.72 

289.40 

168.99 

Test  4 

— 

Correct  Answers  (Pt.  1) 

4.64 

1.98 

3.25 

2.04 

Test  4 

Correct  Answers  (Pt.  2) 

2.17 

1.28 

1.81 

1.11 

Test  S 

- 

Correct  Answers  (Pt.  1) 

15.21 

5:92 

12.33 

5.72 

Test  5 

— 

Correct  Answers  (Pt.  2) 

19.19 

6.52 

15.77 

7.43 

Test  6 

— 

Correct  Answers 

32.68 

6.32 

28.85 

8.07 

Test  7 

- 

line  Error,  Min.  1 

4956. 

1154. 

5988. 

2720. 

Test  7 

- 

Line  Error,  Min.  2 

4965. 

1201. 

6076. 

2724. 

Test  7 

— 

line  Error,  Min.  3 

5121. 

1379. 

5985. 

2573. 

Test  7 

— 

line  Error,  Min.  4 

4840. 

1354. 

5856. 

2520. 

Test  7 

- 

Tone  Error,  Min.  1 

2165. 

667. 

2420. 

951. 

Test  7 

- 

Tone  Error,  Min.  2 

2135. 

789. 

2433. 

948. 

Test  7 

- 

Tone  Error,  Min.  3 

2000. 

759. 

2414. 

1001. 

Test  7 

- 

Tone  Error,  Min.  4 

1902. 

731. 

2371. 

936. 

Test  1 

- 

No  Responses 

7.16 

6.34 

7.32 

5.86 

Test  2 

- 

No  Responses  (Percep) 

1.25 

1.80 

1.20 

3.01 

Test  2 

- 

No  Responses  (Motor) 

1.62 

2.16 

1.41 

3.13 

Test  3 

- 

No  Responses  (Percep) 

.91 

1.37 

1.77 

2.29 

Test  3 

-1 

Mo  Responses  (Motor) 

.94 

1.43 

2.10 

2.77 

Total  No  Responses 

11.87 

8.55 

13.80 

11.40 

Table  3.  Means  and  Standard  Deviations  for 
Navigator  Sample  on  Criterion  and  Paper-and-Pencil 
Measures  (N  = 77) 


Semple 

Mean 

SD 

Training  Disposition  (Grad.  = 1) 

.83 

.37 

AFOQT  - Pilot 

29.77 

37.19 

AFOQT  — Navigator 

41.81 

37.82 

AFOQT  - Officer  Quality 

39.04 

36.73 

AFOQT  - Verbal 

28.91 

30.36 

AFOQT  — Quantitative 

28.71 

30.22 

Table  4.  Means  and  Standard  Deviations  for 
Enlisted  Sample  on  Criterion  and 
Paper-and-Pendl  Measures  (N  = 395) 


Semple 

Mean 

SD 

Training  Disposition  (Grad.  = 1) 

.88 

.32 

Final  ATC  Standard  Score 

82.67 

11.14 

Number  of  Academic  Washbacks 

.19 

.56 

ASVAB—  Administrative 

55.67 

19.68 

ASVAB  — Electronics 

68.08 

17.48 

ASVAB  — General 

68.11 

17.72 

ASV  A B — Mechanical 

64.75 

19.35 
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Table  7.  Interconelation  Matrix  for  Enlisted  Sample 


« PlTiCptK>n) 

U rest  3 No  Ktspi-nM.- 


Table  8.  Zem-Otdft  Validities  for  Enlisted  Subjects  in 
Career  Fidd  20-lnteDigence  (N  = 37) 


VartabI* 

Past/ 

Fall 

ATC 

Final 

Seora 

Wash- 

back* 

VaclabI* 

Pan/ 

Fall 

ATC 

Final 

Score 

Wash- 

back* 

AS  V AB- Administrative 

-.10 

.01 

.00 

Test  6— Correct 
Answers 

-.16 

-.01 

.00 

ASV  AB— Electronics 

.11 

.18 

.00 

Test  7-Line  Error 
Min.  1 

-.13 

-.14 

.00 

ASVAB-General 

.09 

-.01 

.00 

Test  7— line  Error, 
Min.  2 

-.14 

-.13 

.00 

ASV  AB— Mechanical 

.00 

.03 

.00 

Test  7— Line  Error, 
Min.  3 

-.06 

-.06 

.00 

Test  1— Correct 
Answers 

.06 

.15 

.00 

Test  7— line  Error, 
Min.  4 

-.22 

-.19 

.00 

Test  1 —Response 
Time 

.02 

-.12 

.00 

Test  7— Tone  Error, 
Min.  1 

.16 

.20 

.00 

Test  2— Correct 
Answers 

.04 

.08 

.00 

Test  7— Tone  Error, 
Min.2 

.08 

.03 

.00 

Test  2— Perception 
Time 

-.17 

-.30 

.00 

Test  7— Tone  Error, 
Min.  3 

.07 

.03 

.00 

Test  2-Response 
Time 

-.28 

-J4** 

.00 

Test  7— Tone  Error, 
Min.  4 

-.07 

-.10 

.00 

Test  3-Correct 
Answers 

.03 

.11 

.00 

Test  1 —No  Responses 

-.27 

-.28 

.00 

Test  3— Perception 
Time 

.00 

-.13 

.00 

Test  2— No  Responses 
(Perception) 

-.07 

-.15 

.00 

Test  3 -Response 
Time 

.08 

-.02 

.00 

Test  2 -No  Responses 
(Response) 

-.13 

-.11 

.00 

Test  4— Correct 
Answers  (Pt . 1 ) 

.25 

.29 

.00 

Test  3 -No  Responses 
(Perception) 

.09 

-.01 

.00 

Test  4-Correct 
Answers  (Pt.  2) 

.31 

.38** 

00 

Test  3 -No  Responses 
( Response ) 

-.16 

-.13 

.00 

Test  5 -Correct 
Answers  (Pt.  1) 
Test  5— Correct 
Answers  (Pt.  2) 

.28 

22 

.44** 

.30 

00 

.00 

Total  No  Responses 

-.27 

-.30 

.00 

*No  academic  >fcashbacks  tKCurred  in  Lhis  gmup 
••(*^CTit  = .325,  for  p < .05) 


r 
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\ 
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Table  9.  Zero-Order  Validities  for  Enlisted  Subjects  in 
Career  Field  43-Aircraft  Maintenance  (N  = 1 22) 

1 VarlaM* 

Pl»/ 

Fall 

ATC 

Final 

Scora 

Wash- 

back 

VartaWa 

ftu/ 

Fall 

ATC 

Final 

Seen 

Wash- 

back 

ASV  AB— Administrative 

.04 

.12 

-.01 

Test  6— Correct 

.05 

.14 

.00 

Answers 

ASVAB— Electronics 

.11 

.47® 

-.32® 

Test  7— line  Enor, 

-.03 

.02 

-.05 

Min.  1 

ASV  AB— General 

.06 

.39® 

-.09 

Test  7— line  Error, 

-.12 

.00 

.04 

Min.2 

ASV  AB— Mechanical 

.10 

J7® 

-.23® 

Test  7-Line  Error, 

-.05 

.06 

.01 

Min.  3 

i Test  1— Correct 

.01 

.09 

.05 

Test  7— line  Error, 

-.11 

-.02 

.04 

i Answers 

Min.  4 

Test  1— Response 

-.08 

-.22® 

.07 

Test  7— Tone  Enor, 

-.08 

-.17 

.07 

Time 

Min.  1 

Test  2-Correct 

-.09 

-.02 

.09 

Test  7— Tone  Error, 

.00 

-.09 

.08 

Answers 

Min.2 

Test  2— Perception 

-.08 

-.25® 

.12 

Test  7— Tone  Error, 

-.21® 

-.12 

.15 

Time 

Min.3 

Test  2— Response 

-.04 

-.16 

.05 

Test  7— Tone  Error, 

-.04 

-.11 

.11 

Hme 

Min.4 

T»st  3 -Correct 

.08 

.21® 

.02 

Test  1— No  Responses 

.04 

-.17 

-.08 

Answers 

Test  3— Perception 

-.06 

-.05 

-.04 

Test  2— No  Responses 

.04 

.03 

-.08 

Time 

(Perception) 

Teit  3— Response 

-.04 

-.14 

-.06 

Test  2— No  Responses 

.05 

.01 

-.10 

Time 

(Response) 

Teet  4— Correct 

.13 

.24® 

-.23® 

Test  3— No  Responses 

.02 

.00 

-.05 

AAswers(Pt.  1) 

(Perception) 

Teef  4— Correct 

-.12 

.03 

.04 

Test  3— No  Responses 

.09 

-.01 

-.16 

Amwers  (Pt.  2) 

(Response) 

Te?t  5-Correct 

.13 

.22® 

-.13 

Total  No  Responses 

.07 

-.06 

-.14 

An«wers(Pt.  1) 

Test  5— Conect 

.18® 

.30® 

-.15 

Answers  (Pt.  2) 

Table  10.  Zero-Order  Validities  for  Enlisted  Subjects  in  Career 
Field  46-Munitions  and  Weapons  Maintenance  (N  = 62) 


Vartabl« 

Pass/ 

Fall 

ATC 

Final 

Scora 

Wash- 

back 

Varlabit 

PlM/ 

F«a 

ATC 

Final 

SOOfV 

Wash- 

back 

ASV  AB— Administrative 

.19 

.31“ 

-.09 

Test  6— Correct 
Answers 

.09 

.13 

-.10 

ASV  AB- Electronics 

.04 

.20 

-.11 

Test  7— line  Error, 
Min.  1 

.00 

-.09 

.24 

ASVAB— General 

.01 

.14 

-.•02 

Test  7-=-Line  Error, 
Min.  2 

.10 

.02 

.11 

ASV AB- Mechanical 

.28“ 

.42“ 

-.23 

Test  7— Line  Error, 
Min.  3 

.05 

-.05 

.12 

Test  1— Correct 
Answers 

-.09 

-.01 

-.04 

Test  7— Line  Error, 
Min.  4 

-.02 

-.09 

.14 

Test  1- Response 
Time 

-.39“ 

-.36“ 

34“ 

Test  7— Tone  Enor, 
Min.  1 

-.10 

-.14 

.18 

Test  2-Correct 
Answers 

-.13 

-.10 

.06 

Test  7— Tone  Error, 
Min.2 

-.01 

-.06 

.20 

Test  2-Perception 
Time 

-.03 

-.03 

.35“ 

Test  7— Tone  Enor, 
Min.  3 

.11 

.07 

.04 

Test  2-Response 
Time 

.05 

.01 

.46“ 

Test  7— Tone  Error, 
Min.  4 

-.12 

-.17 

.23 

Test  3 -Correct 
Answers 

.00 

.11 

.04 

Test  1 —No  Responses 

-.03 

-.12 

.09 

Test  3-Perception 
Time 

.10 

.04 

.07 

Test  2— No  Responses 
(Perception) 

.09 

-.01 

.03 

Test  3-Response 
Time 

.13 

.08 

.31“ 

Test  2— No  Responses 
(Response) 

.07 

-.03 

-.05 

Test  4-Correct 
Answers  (Pt.  1) 

-.08 

-.03 

-.10 

Test  3— No  Response* 
(Perception) 

.11 

.03 

.07 

Test  4-Correct 
Answers  (Pt.  2) 

-.01 

.10 

.05 

Test  3— No  Responses 
(Response) 

.13 

.03 

.13 

Test  5 -Correct 
Answers  (Pt.  1) 
Test  5-Corrrct 
Answers  (Pt.  2) 

.01 

.01 

.05 

.01 

.04 

-.12 

Total  No  Responses 

.07 

-.06 

.08 

'crit  = .250,  for  p < .05. 
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Table  11.  Zero-Order  Validities  for  Enlisted  Subjects 
in  Career  Field  90-Medical  (N  = 35) 


Varlabla 

PlM/ 

Fall 

ATC 

Final 

Seora 

Wash- 

back 

Variable 

Fau/ 

Fall 

ATC 

Final 

Score 

Wash- 

back 

ASVAB— Administrative 

.17 

.28 

.22 

Test  6— Correct 
Answers 

.07 

.01 

-.16 

ASVAB-Hectronics 

.28 

.42“ 

-.15 

Test  7— Line  Enor, 
Min.  1 

-.13 

-.13 

-.16 

ASVAB— General 

.39“ 

.54“ 

.13 

Te^t  7— line  Error, 
Min.2 

-.01 

.03 

-.13 

ASV  AB— Mechanical 

.17 

.44“ 

-.07 

Test  7— Line  Error, 
Min.3 

-.10 

-.10 

-.11 

Test  1 -Correct 
Answers 

.10 

.21 

.28 

Test  7— line  Error, 
Min.  4 

-.09 

-.05 

-.11 

Test  1— Response 
Time 

-.15 

-.09 

-.09 

Test  7— Tone  Error, 
Min.  1 

-.09 

-.06 

.11 

Test  2-Conect 
Answers 

-.31 

-.03 

.13 

Test  7— Tone  Error, 
Min.2 

-.09 

.01 

-.04 

Test  2— Perception 
Time 

-.15 

-.11 

.12 

Test  7— Tone  Error, 
Min.  3 

-.01 

.03 

.02 

Test  2— Response 
Time 

-.01 

.13 

.03 

Test  7— Tone  Error, 
Min.  4 

-.05 

.05 

.27 

Test  3-Correct 
Answers 

-.21 

-.06 

-.08 

Test  1— No  Responses 

.03 

-.08 

-.20 

Test  3— Perception 
Time 

.02 

-.08 

.05 

Test  2— No  Responses 
(Perception) 

.13 

-.11 

-.06 

Test  3— Response 
Time 

.09 

-.23 

-.01 

Test  2— No  Responses 
(Response) 

.13 

-.06 

-.06 

Test  4-Correct 
Answers  (Pt.  1) 

.31 

.43“ 

-.21 

Test  3— No  Responses 
(Perception) 

.18 

.02 

.01 

Test  4— Correct 
Answers  (Pt.  2) 

.25 

.31 

.01 

Test  3— No  Responses 
(Response) 

.13 

-.02 

-.02 

Test  5 -Correct 
Answers  (Pt.  1) 
Test  5 -Correct 
Answers  (Pt.  2) 

-.04 

-.01 

.19 

.10 

.23 

.01 

Total  No  Responses 

.17 

-.11 

-.16 

*^crit  = .325,  for  p < .05. 
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Table  12.  Regression  Problems  for  Total  Enlisted  Sample  (N  = 395) 


1 CrIUrlon 

No.  of 

r 

Modal 

Pradictors 

Pradicton 

r’ 

F 

Training 

Disposition 


Full 

ASVAB  and  ftychomotor 

30 

.158 

.09 

Restricted“ 

ftychomotor 

26 

.128 

2.57* 

.07 

Restricted*’ 

ASVAB 

4 

.034 

2.06** 

.03 

Final  ATC 
Standard  Score 


Full 

ASVAB  and  ftychomotor 

30 

.215 

.15 

Restrict  ed“ 

Psyehomotor 

26 

.142 

6.72** 

.08 

Restricted*’ 

ASVAB 

4 

.111 

1.85* 

.10 

Number  of 
Academic  Washbacks 


Full 

ASVAB  and  ftychomotor 

30 

.115 

.04 

Restricted“ 

ftychomotor 

26 

.083 

2.63* 

.02 

Restricted*’ 

ASVAB 

4 

.046 

1.09'^ 

.04 

“Null  Hypothesis;  ASVAB  makes  no  contribution  to  Psyehomotor. 
^ull  Hypothesis;  Psyehomotor  makes  no  contribution  to  ASVAB. 

'■Not  Significant. 

»p  < .05. 

•*p  < .01. 


Table  13.  Regression  Problems  for  Enlisted  Sample 
in  Career  Field  43-Aircraft  Maintenance  (N  = 1 22) 


Criterion 

Model 

Predictor* 

No.  Of 
Predictor* 

R’ 

F 

e"’ 

Final  ATC 
Standard  Score 

Full 

ASVAB  and  ftychomotor 

30 

377 

.18 

Restricted“ 

ftychomotor 

26 

.277 

3.61* 

.09 

Restricted*’ 

ASVAB 

4 

.266 

.62*’ 

.25» 

Number  of 
Academic  Washback^ 

Full 

ASVAB  and  ftychomotor 

30 

.314 

.10 

Restricted® 

ftychomotor 

26 

.222 

3,02** 

.02 

Restricted*’ 

ASVAB 

4 

.123 

,9f 

.10 

“Null  Hypothesis;  ASVAB  makes  no  contribution  to  Psyehomotor. 
^Null  Hypothesis.  Psyehomotor  makes  no  contribution  to  ASVAB. 
“^Not  Significant. 

•p  < .01. 

**p<.05. 


17 


I 


! 


.08.  These  correlations  are  somewhat  attenuated 
cfue  to  restriction  in  the  range  caused  by  selection 
of  the  personnel  in  the  sample  based  upon  the 
Navigator  composite,  and  also  because  the  correla- 
tions for  the  AFOQT  composites  were  based  upon 
percentiles— the  original  raw  scores  not  being 
available. 

In  the  regression  problem  comparing  the  con- 
tributions of  AFOQT  and  jKychomotor/perceptual 
scores  for  the  prediction  of  pass/fail  in  under- 
graduate navigator  training  (UNT),  both  sets  of 
predictors  failed  to  achieve  statistical  significance 
in  their  individual  contributions  to  prediction. 
This  may  be  accounted  for  in  part  by  the  small 
sample  size  in  relation  to  the  number  of  predictor 
variables  used.  However,  the  corrected  multiple 
correlations  QR^),  which  are  unbiased  estimates 
of  the  true  correlations  in  the  population,  would 
suggest  that  the  AFOQT  is  less  predictive  of  UNT 
success  than  are  the  psychomotor/ perceptual 
measures. 

Sample  B— Enlisted  Personnel 

For  the  enlisted  sample,  correlations  of  the  pre- 
dictor measures  with  three  training  criteria  were 
obtained.  These  training  criteria  were  (a)  Training 
Disposition-Pass/Fail  (Var.  B-1),  (b)  Final  Air 
Training  Command  (ATC)  Standard  Score  (Var. 
B-2),  and  (c)  Number  of  Acaderhic  Washbacks 
(Var.  B-3).  These  three  training  criteria  were  cho- 
sen for  evaluation  because,  while  individually  they 
each  have  shortcomings  as  an  overall  training 
criterion,  collectively  they  describe  rather  well  the 
outcomes  of  interest  in  a training  situation.  Specif- 
ically, while  the  Training  Disposition— Pass/Fail 
variable  imposes  an  artificial  dichotomy  upon  the 
score  distribution  which  reduces  its  variance  and 
hence  its  psychometric  properties  as  a training 
criterion,  it  is  probably  a measure  of  special 
interest  to  the  organization  performing  the  train- 
ing which  evaluates  its  training  effectiveness  partly 
in  terms  of  the  loss  rate  during  training.  The  Final 
ATC  Standard  Score  gives  a better  distribution  of 
scores  among  students  since  it  is  a continuous 
measure  and  hence  allows  for  better  evaluation  of 
the  predictots  for  distinguishing  between  different 
levels  of  success  in  training.  The  Number  of 
Academic  Washbacks  was  included  because  often 
students  will  be  set  back  due  to  faflure  to  meet 
some  performance  objectives  for  a specified  block 
of  training  and  will  subsequently  graduate  with 
ATC  Standard  Scores  similar  to  other  students 
who  were  able  to  complete  the  training  course 
without  repeating  blocks.  The  number  of  these 
washbacks  is  therefore  interesting  if  one  wishes  to 
cut  down  on  the  number  of  students  who  carmot 
progress  through  the  course  at  the  prescribed  rate. 


In  the  total  sample  (N  = 395),  the  best  single 
predictor  of  Training  Disposition  (B-1)  was  Test 
1— Mean  Response  Time  (B-9)  with  a correlation 
of  —.22.  The  second  and  third  best  single  predic- 
tors were  Test  2-Correct  Answers  (B-10)  and 
ASVAB  Mechanical  composite  (B-7),  with  correla- 
tions of  —.19  and  .14,  respectively.  Error  measures 
were  used  in  several  tests,  resulting  in  negative 
correlations  between  the  measures  and  the  training 
outcome  criteria.  In  all  cases,  the  sign  of  the 
correlation  coefficient  may  be  ignored  and  only 
the  absolute  value  considered. 

For  the  ATC  Standard  Score  (B-2),  the  best 
single  predictor  was  ASVAB  Mechanical  Com- 
posite (B-7)  with  a correlation  of  .30,  while  the 
second  and  third  best  predictors  were  Test 
1— Mean  Response  Time  (B-9)  and  ASVAB 
Electronics  composite  (B-5)  with  correlations  of 
—.21  and  .19,  respectively. 

The  best  three  predictors  of  the  Number  of 
Training  Washbacks  (B-3)  were  the  ASVAB  Me- 
chanical (B-7)  and  Electronics  (B-5)  composites 
and  Test  2— Mean  Response  Time  (B-1 2)  with  cor- 
relations of  -.19,  —.16,  and  .15,  respectively. 

In  the  regression  problems  which  used  the  total 
enlisted  sample  (N  = 395),  results  were  attenuated 
by  the  heterogeneity  of  the  sample  which  included 
subjects  from  many  Air  Force  career  fields.  This 
heterogeneity  of  training  programs,  coupled  with 
the  grouping  together  of  subjects  who  had  been 
preselected  on  the  basis  of  widely  divergent 
Aptitude  Indexes,  may  have  contributed  to  the 
relatively  low  correlations  obtained. 

It  was  found  that  for  the  prediction  of  Training 
Disposition  (Pass/Fail),  both  the  ASVAB  and 
psychomotor/perceptual  measures  made 
statistically  significant  contributions.  The  same  sit- 
uation was  found  in  the  prediction  of  Final  ATC 
Standard  Score.  In  the  prediction  of  Academic 
Washbacks,  however,  the  psychomotor/perceptual 
measures  did  not  make  a significant  contribution. 
In  all  these  cases,  the  amount  of  variance 
accounted  for  by  the  predictors,  as  indicated  by 
the  corrected  multiple  correlations,  was  quite 
small. 

In  the  prediction  of  both  Final  ATC  Standard 
Score  and  Number  of  Academic  Washbacks  for 
subjects  in  career  field  43— Aircraft  Maintenance, 
psychomotor/perceptual  faded  to  make  a signifi- 
cant contribution,  and,  as  in  the  total  samite,  the 
amount  of  variance  accounted  for  by  either  set  of 
predictors  was  small. 

For  subjects  in  career  field  46-Munitions 
Maintenance,  psychomotor/perceptual  measures 
again  failed  to  make  statistically  significant 
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contribution  to  the  prediction  of  either  criterion; 
however,  for  Academic  Washbacks,  the  amount  of 
variance  accounted  for  was  considerably  greater 
than  that  attributable  to  the  ASVAB. 

The  lack  of  more  definitive  results  either  in 
favor  of  or  against  the  psychomotor/perceptual 
measures  may  be  attributed,  as  was  noted  earlier, 
to  the  disproportionate  number  of  predictor 
measures  relative  to  the  number  of  subjects.  In  an 
exploratory  study  of  this  type,  many  predictors 
are  evaluated  in  an  attempt  to  identify  some 
smaller  set  that  may  have  future  promise  When 
coupled  with  small  sample  size,  this  necessarily 
results  in  fewer  statistically  significant  findings. 

Future  studies  which  exclude  those  psychom- 
otor/perceptual measures  that  were  found  to  be  of 
little  predictive  validity  in  this  study  should  result 
in  less  equivocal  fmdings.  This  is  evidenced 
through  the  zero-order  validities  reported  for  both 
the  overall  enlisted  sample  and  the  four  sub- 
samples in  which  certain  of  the  psychomotor/ 
perceptual  measures  yielded  significant  correla- 
tions with  the  criteria. 


VI.  (X)NCLUSIONS  AND  RECOMMENDATIONS 

While  definitive  conclusions  are  not  possible 
due  to  the  limited  scope  of  this  study,  it  would 
appear  that  several  of  the  psychomotor/perceptual 
measures  offer  promise  for  the  improved  selection 


of  Air  Force  persoruiel.  In  particular,  the  psycho- 
motor/perceptual measures  seem  to  be  superior  to 
the  AFOQT  composites  for  the  selection  of  per- 
sonnel for  navigator  training.  Considering  the 
costly  nature  of  navigator  training,  improvement 
through  use  of  these  techniques  could  have  a 
significant  dollar  cost  savings  impact. 

Despite  the  limitations  of  small  sample  sizes 
and  heterogeneity  of  training  programs 
encountered  in  this  study,  it  would  appear  that 
some  of  the  psychomotor/perceptual  measures 
may  be  of  utility  in  the  selection  of  enlisted  per- 
sonnel* for  technical  training.  Wliile  the  joint  con- 
tribupon  of  the  entire  battery  often  failed  to 
achieve  statistical  significance,  the  zero-order 
validities  of  individual  psychomotor/perceptual 
measures  were  often  higher  than  those  of  the 
paper-and-pencil  measures. 

I 

Additional  research  is  recommended  to  further 
evaluate  those  measures  from  the  psychomotor/ 
perceptual  battery  which  demonstrated  appre- 
ciable validity  in  this  study.  Through  the  use  of 
large  homogeneous  samples  of  both  officer  and 
enlisted  personnel,  the  true  utility  of  these  meas- 
ures may  be  accurately  assessed.  Since  these  tests 
are  in  general  unique,  they  may  make  significant 
contributions  to  the  optimal  selection  and  assign- 
ment of  Air  Force  personnel. 
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